Criterion Item Standard Setting
نویسندگان
چکیده
A method for establishing a minimum passing standard for a multiple choice test is described. The procedure is based on expert judgment about the content of test items. The method can also be used to monitor or adjust a standard that is already in place. The procedure carries advantages that are not available from other approaches to standard setting. It is easy to implement and easy for participants to understand. Most important, the sources of a standard based on this approach can be inspected and evaluated easily by people who are not involved in the standard setting process.
منابع مشابه
On Item Mappings and Statistical Rules for Selecting Binary Items for Criterion-Referenced Interpretation and Bookmark Standard Settings
Item mappings are widely used in educational assessment for applications such as test administration (through test form assembly and computer assisted testing) and for criterion-referenced (CR) interpretation of test scores or scale anchoring. Item mappings are also used to construct ordered item booklets in the CTB/McGraw Hill Bookmark standard setting procedure. Selection rules for mapping th...
متن کاملA new IRT-based standard setting method: application to eCat-listening.
BACKGROUND Criterion-referenced interpretations of tests are highly necessary, which usually involves the difficult task of establishing cut scores. Contrasting with other Item Response Theory (IRT)-based standard setting methods, a non-judgmental approach is proposed in this study, in which Item Characteristic Curve (ICC) transformations lead to the final cut scores. METHOD eCat-Listening, a...
متن کاملAnalysis of Clustering Evaluation Considering Features of Item Response Data Using Data Mining Technique for Setting Cut-Off Scores
The setting of standards is a critical process in educational evaluation, but it is time-consuming and expensive because it is generally conducted by an education experts group. The purpose of this paper is to find a suitable cluster validity index that considers the futures of item response data for setting cut-off scores. In this study, nine representative cluster validity indexes were used t...
متن کاملA comparison study of IRT calibration methods for mixed-format tests in vertical scaling
The purpose of this dissertation was to investigate how different Item Response Theory (IRT)-based calibration methods affect student achievement growth pattern recovery. Ninety-six vertical scales (4 × 2 × 2 × 2 ×3) were constructed using different combinations of IRT calibration methods (separate, pair-wise concurrent, semiconcurrent, and concurrent), lengths of common-item set (10 vs. 20 com...
متن کاملThe appropriateness of professional judgement to determine performance rubrics in a graded competency based assessment framework
With the implementation of competency based assessment within the Australian vocational education and training (VET) sector the focus has been on valid and reliable assessments to ensure that there are consistent outcomes across training providers. Underpinning this has being the notion of providing assessment judgements within a dichotomous reporting framework; that is competent or not yet com...
متن کامل